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@ A multimodal hand-held remote control de- 
vice is disclosed which may be utilized for 
selecting designated functions in a plurality of 
multimedia processing units. Multiple user 
selectable keypads are provided for initiating 
transmission of control signals utilizing a wire- 
less bBnsmlsston system, such as an infrared 
transmitter. An electrically alterable graphic de- 
signation is provided in association with each 
user selectable keypad so that a function as- 
sociated with each particular keypad for a given 
multimedia processing unit may be visually de- 
termined. The electrically alterable graphic de- 
signation is then varied in response to selection 
of an alternate nKxJe of operation wherein the 
functions associated with each user selectable 
keypad for an alternate multimedia processing 
unit may be displayed. In one depicted embodi- 
ment a liquid crystal display is provided and a 
touch overlay is mounted in an overlying rela- 
tionship with a portion of the liquid crystal 
display to provide the user selectable keypads. 
Selected menus and textual help messages may 
be loaded into the remote control device utiliz- 
ing an infrared receiver, or an Interface connec- 
tion to a host device. 
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The present invention relates in general to im- 
provements in remote control devices and in particu- 
lar to improvements in remote control devices which 
may be utilized with multiple multimedia processing 
units. Still more particularly, the present invention re- 5 
tates to multimodal remote control devices which in- 
clude electrically alterable keypad designations. 

Modern state-of-the-art electronic systenr^s often 
utilize remote control devices to permit a user to rap- 
idly and efficiently control selected functions from a io 
dtetance. Early mechanical/ultrasonic remote control 
devices were fairly limited and generally permitted 
only one or two functions to be controlled. For exam- 
ple, television remote controls utilizing mechanical/ul- 
trasonic technology generally permitted a user to turn is 
the power on to the television and to cyde through 
each channel in a preselected rotation. 

More recently modern remote control devices util- 
ize electronic systems to transmit control signals by 
way of infrared or radio frequency transmitters. 20 
Indeed, as the functionality and complexity of home 
electronic systems have increased, modern remote 
control devices have become highly complex. It is not 
unusual for such a device to include as many as one 
hundred small buttons or keys, resulting in a severe 25 
decrease in the usability of these devices. Further, 
remote control devices may be utilized to control a 
wide diversity of electronic systems, such as: televi- 
sion; tape recorders; audio/video amplifiers; compact 
dtec players; video tape recorders; satellite receh^ers, 30 
and the like. Thus, the number and complexity of re- 
mote control devices typically found In a modern 
American home have reached a level where the con- 
venience provided is often overcome by the difficulty 
in locating and operating these devices. 35 

Recently an attempt has been made to consoli- 
date multiple remote control devices and improve 
their usability In the provision of a so-called "univer- 
sal" remote control which can "learn" a series of com- 
mands for selecting designated functions within one 40 
or more multimedia processing units. However, the 
generic keypads provided with these devices are of- 
ten cumbersome and not particularly intuitive in lay- 
out or labeling. 

Thus, it should be apparent that a need exists for 45 
a multimodal remote control device which provides an 
intuith^e and simple Interface whereby a user may rap- 
idly and efficiently control multiple multimedia proc- 
essing units. 

It is therefore one object of the present invention 50 
to provide an improved remote control device. 

It is another object of the present Invention to pro- 
vide an improved remote control device which may be 
utilized with multimedia processing units. 

It is yet another object of the present invention to 55 
provide an improved multimodal remote control de- 
vice which includes electrically alterable keypad des- 
ignatkins. 



The foregoing objects are achieved as is now de- 
scribed. A multimodal hand-held remote control de- 
vice is disclosed which may be utilized for selecting 
designated functions in a plurality of multimedia proc- 
essing units. Multiple user selectable keypads are 
provided for initiating transmission of control signals 
utilizing a wireless transmission system, such as an 
infirared transmitter. An electrically alterable graphic 
designation is provided in association with each user 
selectable keypad so that a function associated with 
each particular keypad for a given multi-media proc- 
essing unit may be visually determined. The electri- 
cally alterable graphic designation is then varied in re- 
sponse to selection of an alternate mode of operation 
wherein the functions associated with each user se- 
lectable keypad for an alternate multimedia process- 
ing unit may be displayed. In one depicted embodi- 
ment a liquid crystal display is provided and a touch 
overlay is mounted in an overlying relationship with 
a portion of the liquid crystal display to provide the 
user selectable keypads. Selected menus and textual 
help messages may be loaded into the remote control 
device utilizing an infrared receiver, or an interface 
connection to a host device and selectively displayed 
to a user in response to user inputs. 

The novel features believed characteristic of the 
invention are set forth in the appended claims. The In- 
vention itself however, as well as a preferred mode of 
use, further objects and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
conjunction with the accompanying drawings, where- 
in: 

Figure 1 is a partially schematic, pictorial repre- 
sentatton of the multimodal remote control device 
of the present invention and a plurality of multi- 
media processing units; 

Figures 2a-2c are pictorial representations of 
electrically alterable keypad designations utilized 
with the multimodal remote control device of the 
present invention; 

Figure 3 is a high level block diagram of the major 
electronic components of one embodiment of the 
multimodal remote control device of the present 
invention; 

Figure 4 is a high level logic flow diagram of the 
learning mode of the multimodal remote control 
device of the present Invention; and 
Figure 5 is a high level logic flow diagram of the 
operation of the multimodal remote control device 
of the present invention. 

With reference now to the figures and in particu- 
lar with reference to Figure 1 , there is depicted a par- 
tially schematic pictorial representation of the multi- 
modal remote control device 10 of the present inven- 
tion. As illustrated, multimodal remote control device 
10 is preferably a hand-held battery powered portable 
device which may be utilized to control a plurality of 
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multimedia processing units, such as compact disc 
player 12, video tape recorder 14, television 16, and 
a satellite receiver, such as an Integrated Receiv- 
er/Decoder (IRD). 18. In the depicted embodiment of 
the present invention, multimodal remote control de- 
vice 10 is preferably provided within a case 20 which 
is constructed utilizing plastic or any other suitable 
sturdy material. 

As illustrated, multimodal remote control device 
1 0 preferably includes a graphic display 22 and a plur- 
ality of user selectable keypads 24, 26, 28, 30, 32, 34, 
36, 38, 40, and 42. Additionally, selected command 
keys are provided, such as HELP key 44, HOME key 
46, and MODE key 48. A battery compartment is pro- 
vided which may be utilized to house battery 50 which 
may be utilized to provide electrical power for multi- 
modal remote control device 10 in a manner well 
known in the art. 

As will be illustrated In greater detail herein, each 
of the plurality of user selectable keypads 24-42 in- 
cludes associated therewith a graphic designation 
which identifies a particular function of a multimedia 
processing unit which may be selected upon opera- 
tk>n of an associated user selectable keypad. Addi- 
tionally, graphic display 22 Is provided for the provi- 
sion of textual help messages. Graphic display 22 is 
preferably provided utilizing a liquid crystal display or 
gas plasma display, or any other suitable state-of- 
the-art display device. In a preferred embodiment of 
the present Invention, graphic display 22 is provided 
utilizing any technology which requires minimal elec^ 
trical power, thereby diminishing the power drain on 
battery 50. 

Referring now to Figures 2a-2c, there are depict- 
ed various pictorial representations of electrically al- 
terable keypad designations which may be utilized 
with multinrK>dal rennote. control device 10 of the pres- 
ent invention. As illustrated in Figure 2a, graphic dis- 
play 22 Is utilized to provide a textual designation of 
a particular multimedia processing unit which is to be 
controlled by multimodal remote control device 10 
during the current mode of operatbn. As may be 
seen, each user selectable keypad 24-42 includes a 
textual and/or graphic designation which may be util- 
ized to Identify a particular function within Video Tape 
Recorder 1 which may be selected by the user de- 
pressing an associated user selectable keypad. 

Those skilled in the art will appreciate that user 
selectable keypads 24-42 may be provided utilizing a 
plurality of mechanical switches with each textual 
and/or graphic designation being provided in an adja- 
cent portion of graphic display 22 (see Figure 2b) or, 
in the embodiment depicted within Figure 2a, each 
user selectable keypad 24-42 may be provided by util- 
izing a touch overlay which is disposed in an overly- 
ing relationship with graphic display 22. 

Thus, in the embodiment depicted within Figure 
2a, user selectable keypad 24 may comprise a touch 



overlay disposed in an overlying relationship with a 
portion of graphic display 22 which is utilized to gen- 
erate the textual indication "PLAY" in the manner de- 

5 picted. In this manner, a relatively limited number of 
user selectable keypads (10 in the depicted embodi- 
ment) may be utilized to control a large number of 
functions within a multimedia processing unit by pro- 
viding an electrically alterable keypad designation 

10 which illustrates visually the particular function which 
may be selected by operation of an associated key- 
pad. 

Altering the mode of operation of multimodal re- 
mote control device 10 utilizing nrK>de button 48 or by 

15 utilizing one of user selectable keypads 24-42, will, in 
accordance with an important feature of the present 
Invention, alter the keypad designations which are 
provided utilizing graphic display 22. Further, the se- 
lection of HELP button 44 will, in a manner which will 

20 be explained in greater detail herein, will cause the 
presentation within graphic display 22 of a textual 
HELP message associated with a particular user se- 
lectable keypad. Thus, by depressing HELP button 44 
and a selected one of user selectable keypads 24-42, 

25 a textual help message associated with a function.as: 
sociated with that user selectable keypad may be dis^ 
played within graphic display 22. Finally, HOME but- 
ton 46 may be depressed to return multimodal remote 
control device 10 to a particular starting point which 

30 has been designated by the user. 

Referring specifically now to Figure 2b, a second 
embodiment of multimodal remote control device 10 
of the present Invention Is illustrated. As depicted 
herein, user selectable keypads 24-42 comprise ao- 

35 tual mechanical keypads and the alterable graphic 
designation associated with each keypad is displayed 
adjacent to an associated keypad within graphic dis- 
play 22. Thus, upon reference to Figures 2a and 2b, 
those skilled in the art will appreciate that multimodal 

40 remote control device 1 0 of the present invention may 
be Implemented utilizing either actual keypads having 
an associated electrically alterable graphic designa- 
tion displayed in a position adjacent to each keypad 
or by utilizing a virtual keypad comprising a touch 

45 overlay disposed in an overlying relationship with a 
liquid crystal display, in the manner depicted within 
Figure 2a. 

Referring now to Figure 2c, a virtual keypad im- 
plementation of multimodal remote control device 10 

50 is depicted wherein user selectable keypads 24-42 
are provided utilizing a touch overlay in association 
with graphic display 22. However, user selectable 
keypad 42 now includes the graphic designation 
"MORE" which may be utilized to select subsequent, 

55 or alternate menus for a particular multimedia proc- 
essing unit For example, satellite receivers or Inte- 
grated Receiver/Decodere (IRD) often include a large 
number of highly complex controls. By providing a 
series of nested menus and dedicating at least one of 
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user selectable keypads 24-42 to permit the user to 
select subsequent menus, a highly complex device, 
such as a satellite receiver, may be simply and easily 
controlled utilizing multimodal remote control device 5 
1 0 of the present invention. 

With reference now to Figure 3. there is depicted 
a high level block diagram of the major electronic 
components of one embodiment of multimodal rennote 
control device 1 0 of the present invention. As iilustrat- io 
ed, these components are nnounted within case 20 
and the illustration includes a dock diagram repre- 
sentation of graphic display 22. As described above, 
graphic display 22 comprises a liquid crystal display 
in one preferred embodiment of the present invention. is 
Graphic display 22 is coupled to processor 62, which 
preferably comprises an appropriately programmed 
microprocessor, which may be utilized to control 
graphic display 22 and to scan keypad 60 in a manner 
well known in the art. As described above, keypad 60 20 
may ccMnprise a touch overlay, or a plurality of mech- 
anical keypads disposed adjacent to graphic display 
22. Thus, depression of a selected key within keypad 
60 will, in a manner well known to those skilled in the 
art, cause processor 62 to couple an appropriate 25 
command to transmitter 66. Transmitter 66 then trans- 
mits an appropriately coded control signal utilizing in- 
frared, radio frequency, or other suitable media, to 
one of a plurality of multimedia processing units, in or- 
der to initiate a particular function therein. 30 

In accordance with an important feature of the 
present invention, multimodal remote control device 
1 0 also preferably includes a receiver 68. Receiver 68 
may comprise an infrared receiver or, in an alternate 
embodiment of the present invention, receiver 68 may 35 
be coupled to a host 72 via a standard interface 70, 
such as the RS-232 interface. Thus, processor 62 
may receive menus, textual help messages and addi- 
tional programming information from a controlled mul- 
timedia processing unit, or host 72, and store that in- 40 
formation within memory 64 in association with proc- 
essor 62. In this manner, multimodal remote control 
device 10 may be programmed with appropriate infor- 
mation necessary to control a large number of multi- 
media processing units and, the amount of confusion 45 
encountered by the user is minimized by providing a 
relatively small number of keypads, each associated 
with an electrically alterable graphic designation, 
wherein a particular function associated with that 
keypad in a particular mode of operation may be vis- 50 
ually determined. Additionally, Figure 3 also depicts 
battery 50 which, in a manner well known to those 
skilled in the electronic art, may be utilized to provide 
the necessary electaical power to operate the depict- 
ed electrons components within multimodal remote 55 
control device 10. 

Referring now to Figure 4, there is depicted a 
high level logic flow diagram of the learning mode of 
multimodal remote control device 10 of the present in- 



vention. As illustrated, this process begins at block 80 
and thereafter passes to block 82 which depicts a de- 
termination of whether or not the learning mode has 
been selected. If not, the process merely iterates until 
such time as the learning nrKxie has been selected. 
Upon a determination that the learning mode has 
been selected, the process passes to block 84. Block 
84 illustrates a determination of whether or not a host 
has been coupled to multimodal remote control de- 
vice 10 utilizing receiver 68 and an infrared or radio 
frequency link, or alternately, utilizing interface 70 
which provides a hanj wired coupling to host 72 (see 
Figure 3). In the event no host is coupled to multimo- 
dal renrK>te control device 10, block 86 illusti^ates the 
returning of an error message utilizing graphic display 
22, in a manner well known in the art 

Referring again to block 84, in the event the 
learning mode has been entered and a host device is 
coupled to multimodal remote control device 1 0, block 
88 illustrates the downloading of appropriate menus/ 
help data for a particular multimedia processing unit 
to be stored within memory 64 within multimodal re- 
mote conb*ol device 10. Thereafter, the process pass- 
es to block 90. Block 90 illustrates a determination of 
whether or not a series of menus and help data is to 
be loaded for a subsequent multifunction processor, 
and if so, the process returns iteratively to block 88 
to download that information to multimodal remote 
contirol device 10. In the event no additional multime- 
dia processor data is to be loaded, the process pass- 
es to block 92 and returns. 

Finally, with reference to Figure 5, there is depict- 
ed a high level logic flow diagram of the operation of 
multimodal remote control device 10of the present in- 
vention. As illustrated, this process begins at block 
1 00 and thereafter passes to block 1 02 which depicts 
a determination that a mode has been selected. As 
those skilled in the art will appreciate upon reference 
to the foregoing a mode may be selected utilizing mul- 
timodal remote control device 10 by the selection of 
HOME key 46, MODE key 48, or a graphically desig- 
nated "MORE" key, in the depicted embodiment of 
the present invention. If no mode has been selected, 
the process merely iterates until such time as a mode 
of operation has been selected. 

Referring again to block 1 02, in the event a mode 
has been selected, the process passes to block 104 
which illustrates the retrieval of the menu for the se- 
lected mode of operation. Thereafter, the process 
passes to block 106 which depicts the altering of the 
displayed menu to the appropriate menu for the se- 
lected mode. As described above, this may be accom- 
plished by altering the graphic and/or textual designa- 
tions provided within graphic display 22, in the man- 
ner described within Figures 2a-2c. 

Next, the process passes to block 1 08 which illus- 
trates the scanning of the keypad to detect an oper- 
ator input This process continues, as depicted at 
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block 110, in which a determination is illustrated as to 
whether or not the mode of operation has been al- 
tered! If so, the process returns to block 104 to re- 
trieve the menu for the newly selected mode of oper- 
ation and the process returns iteratively in the man- 
ner described. In the event the mode of operation has 
not been altered, as depicted at block 110, the proc- 
ess passes to block 112. Block 112 Illustrates a deter- 
mination of whet her or not the HELP key has been se- 
lected. If so, the process passes to block 114 which 
illustrates the displaying of the HELP text for a select- 
ed keypad, in the manner described above. The proc- 
ess then returns to block 108 to continue to scan the 
keypad for subsequent operator inputs. 

Referring again to block 112, in the event the 
mode of operation has not been altered and the HELP 
key has not been selected, the process passes to 
block 120. Block 120 illustrates a determination of 
whether or not a "MORE" key has been selected. If so, 
the process passes to block 122. Block 122 illustrates 
the altering of the display within graphic display 22 to 
depict an alternate menu for the selected mode of op- 
eration. The process then returns to block 108 to con- 
tinue scanning the keypad. 

Referring again to block 120, in the event the 
"MORE" key has not been selected, the process 
passes to block 124. Block 124 illustrates a determi- 
nation of whether or not a graphically designated key- 
pad has been selected and if not, the process passes 
back to block 108 to continue scanning the keypad as 
illustrated. Referring again to block 124 in the event 
a graphically designated keypad has been selected, 
block 126 illustrates the transmission of the associat- 
ed control signal via transmitter 66 (see Figure 3) in 
the manner described above. Thereafter, the process 
passes to block 1 08 to continue scanning the keypad. 

Upon reference to the foregoing those skilled in 
the art will appreciate that the Applicant herein has 
provided a novel, unobvlous and useful multimodal re- 
mote control device which provides a highly intuitive 
and highly usable interface through which a user may 
selectively control multiple functions in a plurality of 
multimedia processing units. By providing a relatively 
few number of user selectable keypads, each having 
an electrically alterable graphic designation associat- 
ed therewith, many modes of operation may be sup- 
ported while clearly illustrating to the user each des- 
ignated function associated with a user selectable 
keypad within each mode of operation. 

While the invention has been particularly shown 
and described with reference to a preferred embodi- 
ment, it will be understood by those skilled in the art 
that various changes in form and detail may be made 
therein without departing from the spirit and scope of 
the invention. 



Claims 

1. A hand-held remote control device for selecting 
5 designated functions in a multifunction process- 

ing unit, said remote control device comprising: 
a plurality of user selectable keypads; 
wireless transmission means coupled to said 
plurality of user selectable keypads for transmit- 
10 ting a selected control signal to said multifunction 
processing unit in response to an operation of 
each of said plurality of user selectable keypads 
wherein a designated function in said multifunc- 
tion processing unit associated with each of said 
15 plurality of user selectable keypads may be se- 

lected; and 

at least one electrically alterable graphic designa- 
tion disposed in association with a particular one 
of said plurality of user selectable keypads 
20 wherein a designated function in said multifunc- 

tion processing unit associated with said particu- 
lar one of said plurality of user selectable key- 
pads may be visually determined. 

25 2. The hand-held remote control device according 
to Claim 1, wherein said wireless transmission 
means comprises an infrared transmitter and 
means for modulating an output thereof. 

30 3. The hand-held remote control device acdsrding 
to Claim 2, further including an infrared receiver 
for receiving data from said multifunction proc- 
essing unit. 

35 4. The hand-held remote control device according 
to Claim 1, further Including a graphic display. 

5. The hand-held remote control device according 
to Claim 4, wherein said plurality of user select- 

40 able keypads are disposed adjacent to said 

graphic display and wherein said at least one 
electrically alterable graphic designation com- 
prises a graphic designation displayed within 
said graphic display at a location adjacent to said 
45 particular one of said plurality of user selectable 

keypads. 

6. The hand-held remote control device according 
to Claim 4, wherein said plurality of user select- 

50 able keypads comprises a touch overlay dis- 

posed in overlying relationship with at least a por- 
tion of said graphic display. 

7. The hand-held remote control device according 
55 to Claim 4, wherein said graphic display compris- 
es a liquid crystal display. 
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8. A hand-held remote control device having a plur- 
ality of modes of operatbn for selecting designate 



5 



9 EP 0 566 516 A1 10 

ed functions in a plurality of multimedia process- to Claim 11, wherein said graphic display conv 

ing units, said remote control device comprising: prises a liquid crystal display, 

means for selecting a mode of operation from said 
plurality of modes of operation; s 
a plurality of user selectable keypads; 
wireless transmission means coupled to said 
plurality of user selectable keypads for transmit- 
ting a selected control signal to a particular one 
of saki plurality of multimedia processing units in io 
response to an operation of each of said plurality 
of user selectable keypads during a mode of op- 
eration associated with said particular one of said 
plurality of multimedia processing units wherein a 
designated function in said particular one of said is 
plurality of multimedia processing units may be 
selected; 

at least one electrically alterable graphic designa- 
tion disposed in association with a particular one 
of said plurality of user selectable keypads 20 
wherein a designated function in said particular 
one of said plurality of multimedia processing 
units associated with said particular one of said 
plurality of user selectable keypads may be visu- 
ally determined; and 25 
means for selectively varying said electrically al- 
terable graphic designation in response to selec- 
tion of an alternate mode of operation. 

9. The hand-held remote control device according 30 
to Claim 8, wherein said wireless transmission 
means comprises an infrared transmitter and 
means for modulating an output thereof. 

10. The hand-held remote control device according 35 
to Claim 8, further including an infrared receiver 

for receiving data from saki plurality of multimedia 
processing units. 

11. The hand-held remote control device according 40 
to Claim 8, further including a graphic display. 

12- The hand-held remote control device according 
to Claim 11 , wherein said plurality of user select- 
able keypads are disposed adjacent to said 45 
graphic display and wherein said at least one 
electrically alterable graphic designation conv 
prises a graphic designation displayed within 
said graphic display at a location adjacent to said 
particular one of said plurality of user selectable so 
keypads. 

13. The hand- held remote control device according 
to Claim 11, wherein said plurality of user select- 
able keypads comprises a touch overlay dis- 55 
posed in overlying relatk>nship with at least a por- 
tion of said graphic display. 

14w The hand-held remote control device according 
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